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Non-Destructive Optical Imaging System 
For Enhanced Lateral Resolution 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This application claims priority to U.S. Provisional Application Serial No. 60/412,827 titled 

"High-Resolution Vertical Scanning Interferometry," filed July 31, 2002, and incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 
Technical Field of the Invention 

10 The present invention relates generally to optical devices and more particularly to optimizations 

of optical devices. 

Background Information 

Optical devices, such as cameras and microscopes, use electromagnetic radiation to obtain 

information describing a target object. For example, a microscope may use electromagnetic radiation 
15 in the form of visible light to obtain an image of microscopic bacteria. The information obtained from 

an optical device describing a target object has an associated characteristic, referred to as resolution. 

The resolution defines the capacity of the optical device to resolve closely spaced features of the target 

object. The resolution of an optical device may depend upon a number of factors, including the 

inherent physical characteristics of the device and the wavelength of electromagnetic radiation used by 
20 the device. 

An optical device may be used to produce an image of the target object. The image may 
comprise elements referred to as "pixels." Each pixel is associated with a single value that represents a 
measured property on the surface of the target object. The measured property may include brightness, 
temperature, height, reflectivity, or any other meaningful characteristic of a surface. Typically, each 

25 pixel is associated with a specific surface area of the target object. The area is often referred to as the 
"footprint" of the pixel. The value associated with a particular pixel may represent the average of the 
measured property over the footprint of the pixel. 

An array of pixels forms an image. The array of pixels is most often in a square or rectangular 
pattern, but other patterns (e.g., circular) may also be used. The imaged area of the target object is 

30 determined by the spacing and number of pixels in each of two, usually orthogonal, directions. The 
pixel spacing in a direction is the distance on the surface of the target object between the center points 
of two adjacent pixel footprints. The spacing may be different in the two, usually orthogonal, 
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directions. The image length along one direction is given by the pixel spacing in that direction 
multiplied by the number of pixels in that direction. 

Lateral resolution is a measure of how close two features on the surface of a target object may 
reside and still be distinguished in an image as two distinct features. Pixel spacing is often used as a 
5 rough indicator of the lateral resolution. Typically, two features must be separated by at least two times 
the pixel spacing. In some imaging systems, there may be additional constraints on the lateral 
resolution due to the overlapping of adjacent pixel footprints. When the additional constraints exist, the 
lateral resolution may be poorer than two times the pixel spacing. 

BRIEF SUMMARY 

10 In some embodiments, an optical imaging system comprises a non-destructive optical device 

that obtains information concerning a target object and a X,Y positioning system that is capable of 
positioning one or both of the target object and the optical device to pre-determined offset locations 
more closely spaced than the obtainable resolution of the optical device. A first "base" image is 
produced and then overlapping additional images may be produced by the positioning one or both of 

15 the target object and the optical device to the pre-determined locations. The first, image and the 
additional images may be combined to produce a single combined image that contains inherently more 
information than the first image or any of the additional images alone. The combined image then may 
be digitally restored and enhanced to produce an image with a greater resolution than the optical device 
yields. 

20 NOTATION AND NOMENCLATURE 

Certain terms are used throughout the following description and claims to refer to particular 
system components. As one skilled in the art will appreciate, various companies may refer to a 
component by different names. This document does not intend to distinguish between components that 
differ in name but not function. In the following discussion and in the claims, the terms "including" 

25 and "comprising" are used in an open-ended fashion, and thus should be interpreted to mean 
"including, but not limited to...". Also, the term "couple" or "couples" is intended to mean either an 
indirect or direct connection. Thus, if a first device couples to a second device, that connection may be 
through a direct connection, or through an indirect connection via other devices and connections. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 For a more detailed description of the preferred embodiments of the present invention, 

reference will now be made to the accompanying drawings, wherein: 
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Figure 1 illustrates a diagram of exemplary interferometric system in accordance with 
preferred embodiments of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The following discussion is directed to various embodiments of the invention. Although one or 
5 more of these embodiments may be preferred, the embodiments disclosed should not be interpreted, or 
otherwise used, as limiting the scope of the disclosure, including the claims, unless otherwise specified. 
In addition, one skilled in the art will understand that the following description has broad application, 
and the discussion of any embodiment is meant only to be exemplary of that embodiment, and not 
intended to intimate that the scope of the disclosure, including the claims, is limited to that 
10 embodiment 

The subject matter disclosed herein is directed to an optical imaging system that includes a non- 
destructive optical device and a positioning system that precisely and controllably moves one or both of 
a target object and the optical device to pre-determined locations. A series of images with overlapping 
pixel footprints may then be acquired and software may combine the acquired images and restore the 
15 combined images to improve the lateral resolution. Merely by way of example, the embodiments 
described herein are directed to a Vertical Scanning Interferometric (VST) imaging system with an X-Y 
positioning system. 

In accordance with preferred embodiments, a "non-destructive optical device" may include, but 
is not limited to, interferometric imaging systems and microscopic systems, that create images on a 

20 small scale. The object desired to be imaged by the imaging system may be referred to as the "target 
object." The non-destructive nature of the optical device allows for a non-contact measurement of 
target objects, such as living organisms, that may be sensitive to contact and low wavelength 
electromagnetic radiation. The "obtainable resolution" of the optical device is the maximum 
sustainable lateral resolution capable of being produced solely by the optical device. 

25 In accordance with the preferred embodiments, the lateral resolution of an imaging system with 

an optical device may be enhanced by acquiring a series of images. The "base" image is a single image 
acquired by the imaging system. All images after the first, base image may be referred to as 
"additional" images. Each additional image may be acquired by the same imaging system, but one or 
both of the target object and the optical device is moved to a new position different from that of the 

30 base image or any of the previous additional images via the positioning system. The new position is 
pre-determined and oflset from the base image by a distance smaller than the obtainable resolution of 
the optical device. 
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The preferred embodiment utilizes additional images that are offset from the base image by 
"sub-pixel" distances or sub-pixel plus integer full-pixel distances. A sub-pixel distance is a distance in 
a direction less than the pixel spacing in that direction. The result of a sub-pixel offset is that the 
footprint of many or all of the pixels in an additional image may be different from the footprint of the 
5 pixels in the base or previous additional images. In accordance with the preferred embodiments, the 
difference in the pixel footprint distribution yields the additional information that may enhance the 
lateral resolution. 

In contrast, there are possible movements that do not yield additional information. For 
example, it is possible to move the target positioning system or the optical device to a new position in 

10 which all of the pixel footprints exactly overlay the pixel footprints of the base image. For example, in 
a square grid of pixels, if the target positioning system is moved exactly one pixel spacing along the 
alignment direction of the pixels and a new image is taken, then each pixel footprint (with the exception 
of some pixels on the outside edge of the image) is identical to the footprint of the neighboring pixel in 
the previous image. In this case the new image offers no additional useful information. The same is 

15 true with movements by integer multiples of the pixel spacing along either of the alignment direction of 
the pixels. It may also be true for movements by combinations of integer movements along both 
alignment directions of the pixels. 

The preferred embodiments may utilize any pattern of sub-pixel movements to enhance lateral 
resolution. Examples of possible patterns are 1) translations of the target object in small equal steps in 

20 the directions of pixel alignment, 2) translations of the target object in a finely spaced rectangular grid 
oriented in the directions of pixel alignment, 3) rotation of the target object in small steps about a point 
inside or outside the image area, and 4) translations of the target object in a finely spaced triangular 
grid. The same set of patterns apply to the movement of the optical device associated with the imaging 
system rather than the movement of the target object. The effectiveness of the enhanced lateral 

25 resolution may depend upon the pattern of sub-pixel movements chosen. 

In alternative embodiments, random sub-pixel movements may also be used. With random 
sub-pixel movements, there is no pattern to the relative positions of the base image and additional 
images. The series of positions may, in general, be different for every attempt to increase resolution. 
Each random position is pre-determined by the imaging system. 

30 VSI, one type of a non-destructive optical device, is a technique for quantifying the topography 

of a reflective, solid surface. The information obtained from a VSI may be referred to as an 
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"interferogram." Typically, the interferogram obtained from a VSI scan is rendered into an image in 
which each pixel value represents the height of a respective part of the target object's surface. 

For many tasks, as is true of every optical imaging system, the obtainable lateral resolution 
associated with a VSI device may be insufficient. In accordance with the preferred embodiments, 
5 enhanced lateral resolution may be achieved by taking multiple scans of a target object at sub-pixel 
offsets from a targeted location. | 

Referring now to Figure 1, an exemplary interferometric system 100 is shown. Although any 
type of interferometer, such Michelson and Linnik, may be used, Figure 1 illustrates an exemplary 
Mirau interferometric system 100. The interferometric system 100 comprises a main body 102 with an 
10 illuminator 104. In addition, a beam splitter 106, a target object 114, a reference mirror 110, and a 
reference plate 112, and a position system 108 are included in the interferometer system 100. Other 
components, such as a camera system 118 and a computer system that stores information generated by 
the optical device, and other configurations of the components may be similarly used. 

The VSI system may directly produce two types of images, a 2-dimensional reflected light 
15 image of the target object, and interferograms of the target object's surface. The information stored in 
the interferograms may be used to generate a third type of image that is a three-dimensional height map 
of the target object's surface. The three-dimensional height map may be viewed as a three-dimensional 
surface. Typically, the interferogram is produced by splitting light from the illuminator 104 into two 
beams by the beam splitter 106. The first beam is incident on a target object 1 14 and the second beam 
20 is incident on the reference mirror 110 that is coupled to the reference plate 112. The first beam travels 
a distance referred to as the "target path," whereas the second beam travels a distance referred to as the 
"reference path". The first and second beams reflect off the target object 1 14 and the reference mirror 
110 respectively and combine to produce a single beam. If the target path and the reference path are 
different lengths, the combination of the two beams produces interference. Since the reference path 
25 from the beam splitter 106 to the reference mirror 110 is known, the resulting interference patterns, 
referred to as interference fringes, may be used to determine the length of the target path, and hence the 
distance to the target object 114. The lateral resolution of each of the three different image types, the 
reflected light image, the interferogram(s), and the height map, produced by the VSI system 100 may 
be enhanced by the disclosed method. 
30 In some embodiments, the target object 1 14 is placed on the positioning system 108 that allows 

controlled movements with nanometer-precision. These movements are used to position the target 
object 114 to the sub-pixel location, as previously discussed. In other embodiments, the positioning 
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system is integrated into the objective side of the optical device and the positioning system moves the 
objective (or lense) to the desired sub-pixel locations. 

Typically, any positioning system coupled with an optical device has been used for positioning 
the target object under the optical device so that the desired part of the target object can be observed in 
5 the correct position. This type of positioning may be achieved by using X-Y stage devices, tip-tilt 
devices, rotation devices, or combinations of them. However, this type of positioning occurs at a larger 
scale (i.e., the micrometer (10" 6 ) to millimeter (10~ 3 )) than the sub-pixel movements carried out by the 
positioning system 108. 

In some embodiments, a combination of a nano-positioning device with a micro- to millimeter 
10 precision positioning device is used. However, the latter device may have a tolerance, referred to as 
"play," of more than 1 micrometer. The micro-precision device preferably is locked into position either 
mechanically, electro-mechanically, or by a combination of mechanical and electro-mechanical means 
and coupled with a nano-positioning device to achieve the sub-pixel movements. 

After a series of base and additional images have been obtained from the imaging system, the 
15 series of images may be "combined" into a single, combined image with smaller pixel spacing than that 
of the base image or any of the additional images. The combining of images can be facilitated if the 
images are acquired in a pattern that is compatible with the base image pixel spacing. 

In some embodiments, image processing techniques may be used prior to image combination. 
For example, noise may be reduced in each image in the series. The noise reduction may be 
20 accomplished using filters in which the desired filtering parameters are based on the nature of the noise 
present in the images. Random noise may also be reduced by acquiring multiple images without offset. 
These multiple images may be summed and divided by the number of images to create a single image 
with higher signal with respect to noise ratio. The resulting image can be used instead of a single image 
in the series of offset images. 
25 For combination to be effective and yield resolution enhancement, each of the images in the 

series to be combined also may "balanced." Balance refers to the relative levels of a property (e.g., 
contrast, illumination) associated with images. A relatively simple example of unbalanced images 
would be two images acquired with different levels of illumination. One image may be systematically 
brighter than the other image. If combined in previously mentioned way for enhancing lateral 
30 resolution, the resulting combined image would have a checkerboard appearance caused by the addition 
of short period noise. The noise may tend to swamp the subtle variations in pixel value that are 
exploited to achieve the enhanced lateral resolution. Each additional image may be processed by 
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comparison to the base image to balance the images. For example, the base image is interpolated to 
predict the values at the offset pixel locations in an additional image. The difference between the 
interpolated base image and the additional image is filtered to remove the short period variations and 
leave the long period variations. The filtered difference image is then added to the additional image. 
5 The parameters associated with the balancing and filtering may be selected based upon the 
characteristics (e.g., size, type of noise) of the images. 

If a series of images is acquired on a regular grid of offsets from the base image, and if the grid 
spacing is set to be the base image pixel spacing divided by an integer, then the combination of the base 
and the additional images may be simplified. For example, a complete series of base image plus 
10 additional images may consist four images. The position of the base image is, by definition, given by 
the vector (0, 0). The first number in this vector is the offset in units of the pixel spacing in one 
orthogonal direction of alignment of the pixels. This direction may hereafter be referred to as the X- 
axis. The second number in this vector is the offset in units of the pixel spacing in the other direction 
of pixel alignment. This direction may hereafter be referred to as the Y-axis. The three additional 
15 images may be obtained with the target object positioned at (0.5, 0), (0, 0.5), and (0.5, 0.5) relative to 
the base image (0, 0). The four images may be combined by taking alternate pixels from each image. 
Each group of four neighboring pixels in the combined image consists of one pixel from each of the 
four images in the series. In the resulting combined image, the pixel spacing in each direction is now 
half that of the base image. The total area of the surface of the target covered by the combined image is 
20 essentially the same as that of the base image. Thus, the lateral resolution may be enhance by a factor 
of two. The lateral resolution may be enhanced by any factor desired by obtaining more additional 
images at closer offset locations. 

If the relative positions of the series of acquired images do not have a pattern that relates to the 
pixel distribution in the image, the process of combining the images may be more difficult. The 
25 principal objective of the "combining" step is to fill in additional pixels between the pixels in the base 
image. Ideally, the additional pixels should fall on a regular grid within the base image pixels. If the 
pattern of positions is chosen carefully, as described above, the pixels of the additional images may fall 
exactly on a regular grid within the base image pixels. On the other hand, if the pixels in the additional 
images have a different pattern or are random, having no pattern, then they may not fall exactly on a 
30 regular grid. In this case, interpolation will be required to estimate the value of a pixel at a desired 
location from the values of nearby pixels selected from the base image and series of additional images. 
The number of pixels that can reasonably be added between the pixels of the base image is a function 
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of how many additional images are acquired and how evenly they are positioned. The number of 
additional images required is roughly related to the square of the desired factor resolution 
improvement. 

Although the pixels in the combined image are spaced more closely than in the base image or 
5 the additional images and the image may have a smoother appearance than that of the base image, the 
true lateral resolution may not been increased be the combination process. If the footprint of a pixel in 
the base image covered an area of the target object's surface without overlapping the footprint of any 
other pixel, then the footprint of each pixel in the combined image will cover the area four, now 
smaller, pixels. In this case, lateral resolution does not correlate directly with pixel spacing. However, 
10 there is inherently more information in the combined image than in the base image. The combined 
image may be treated as an image that has the full lateral resolution of the closer pixel spacing of the 
combined image (i.e., without the pixel footprint overlap) that has been blurred. A type of blurring 
occurs when each pixel in an image is the average of the surface property in a footprint larger than the 

pixel itself. So, the combined image is a blurred version of an image with enhanced lateral resolution. 

I 

15 Removal of blurring (i.e., "deblurring") in an image is commonly done using a two 

dimensional deconvolution. Deconvolution is the inverse of a convolution. Blurring is often modeled 
as the convolution of an image with an operator that describes how the footprint of the neighboring 
pixels overlap. The operator is known as a "point spread function." Typically, a method of two- 
dimensional deconvolution may reduce or remove the blurring in the combined image. There are a 

20 large number of standard numerical techniques for performing two-dimensional deconvolution. A 
common technique is Weiner Deconvolution. The use of the Weiner Deconvolution requires that one 
knows the point spread function of the blurring. Determining the appropriate point spread function for 
a given imaging system requires knowledge of the system. There are so-called "blind deconvolution" 
methods that extract an estimate of the point spread function directly from the blurred image and these 

25 can also be used on the combined image. Because of the broad applicability of image restoration using 
deconvolution methods, the range and power of the available numerical tools is expanding 
continuously and any method may be used to deblur the combined image to produce an image with the 
desired enhanced lateral resolution. 

Numerous variations and modifications will become apparent to those skilled in the art once the 

30 above disclosure is folly appreciated. It is intended that the following claims be interpreted to embrace 
all such variations and modifications. 
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